On the Regression Approach to Structured Output Regression ICML 2013 – SUPPLEMENTARY MATERIAL
نویسندگان
چکیده
In this supplementary material, we make use of the following notation. x i denotes the i th entry of the (column) vector X(x), y j the j th entry of the (column) vector Y (y), V[i; j] denotes the entry in position (i, j) of the matrix V. Also, V[ ; j] denotes the j th column of the matrix V. Finally, δ i,j denotes the delta function which gives 1 if i = j, and 0 otherwise. 7. Example of a distribution where the minimizer of the quadratic risk has a substantial higher error rate than the optimal classifier We consider a simple one-dimensional binary classification problem where X = R and Y = {−1, +1}. We thus consider classifiers identified by a single scalar weight w such that the output h w (x) on an input x is given by h w (x) = sgn(wx).
منابع مشابه
Risk Bounds and Learning Algorithms for the Regression Approach to Structured Output Prediction
We provide rigorous guarantees for the regression approach to structured output prediction. We show that the quadratic regression loss is a convex surrogate of the prediction loss when the output kernel satisfies some condition with respect to the prediction loss. We provide two upper bounds of the prediction risk that depend on the empirical quadratic risk of the predictor. The minimizer of th...
متن کاملA Generalized Kernel Approach to Structured Output Learning
We study the problem of structured output learning from a regression perspective. We first provide a general formulation of the kernel dependency estimation (KDE) approach to this problem using operator-valued kernels. Our formulation overcomes the two main limitations of the original KDE approach, namely the decoupling between outputs in the image space and the inability to use a joint feature...
متن کاملMultiple Fuzzy Regression Model for Fuzzy Input-Output Data
A novel approach to the problem of regression modeling for fuzzy input-output data is introduced.In order to estimate the parameters of the model, a distance on the space of interval-valued quantities is employed.By minimizing the sum of squared errors, a class of regression models is derived based on the interval-valued data obtained from the $alpha$-level sets of fuzzy input-output data.Then,...
متن کاملFast metabolite identification with Input Output Kernel Regression
MOTIVATION An important problematic of metabolomics is to identify metabolites using tandem mass spectrometry data. Machine learning methods have been proposed recently to solve this problem by predicting molecular fingerprint vectors and matching these fingerprints against existing molecular structure databases. In this work we propose to address the metabolite identification problem using a s...
متن کاملOptimizing the F-Measure in Multi-Label Classification: Plug-in Rule Approach versus Structured Loss Minimization
We compare the plug-in rule approach for optimizing the Fβ-measure in multi-label classification with an approach based on structured loss minimization, such as the structured support vector machine (SSVM). Whereas the former derives an optimal prediction from a probabilistic model in a separate inference step, the latter seeks to optimize the Fβ-measure directly during the training phase. We i...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012